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Abstract 



New generation cellular networks have been forced to support high data rate communi- 
cations. The demand for high bandwidth data services has rapidly increased with the 
advent of bandwidth hungry applications. To fulfill the bandwidth requirement, high 
throughput backhaul links are required. Microwave radio links operating at high fre- 
quency bands are used to fully exploit the available spectrum. Generating high carrier 
frequency becomes problematic due to the hardware limitations. Non-ideal oscillators 
both at the transmitter and the receiver introduces time varying phase noise which 
interacts with the transmitted data in a non-linear fashion. Phase noise becomes a 
detrimental problem in digital communication systems and needs to be estimated and 
compensated. In this thesis receiver algorithms are derived and evaluated to mitigate 
the effects of the phase noise in digital communication systems. 

The thesis is organized as follows: In Chapter 3 phase noise estimation in single-input 
single-output (SISO) systems is investigated. First, a hard decision directed extended 
Kalman filter (EKF) is derived and applied to track time varying phase noise for an 
uncoded system. Next, the problem of phase noise estimation for coded SISO system is 
investigated. An iterative receiver algorithm performing code-aided turbo synchroniza- 
tion is derived using the expectation maximization (EM) framework. Two soft-decision 
directed estimators in the literature based on Kalman filtering, the Kalman filter and 
smoother with maximum likelihood average (KS-MLA) and the extended Kalman fil- 
ter and smoother (EKS), are evaluated. Low density parity check (LDPC) codes are 
proposed to calculate marginal a posteriori probabilities and to construct soft decision 
symbols. Error rate performance of both estimators, the KS-MLA and the EKS, are 
determined and compared through simulations. Simulations indicate that comparison 
on the performance of the existing estimators heavily depends on the system parameters 
such as block length and modulation order which are not taken into consideration in the 
literature. 

In Chapter 4 the thesis focuses on phase noise estimation in multi-input multi-output 
(MIMO) systems. MIMO technology is commonly used in microwave radio links to im- 
prove spectrum efficiency. First, an uncoded MIMO system is taken under consideration. 
A low complexity hard decision directed EKF is derived and evaluated. A new MIMO 
receiver algorithm that iterates between the estimator and the detector, based on the EM 
framework for joint estimation and detection in coded MIMO systems in the presence 
of time varying phase noise is proposed. A low complexity soft decision directed ex- 
tended Kalman filter and smoother (EKFS) that tracks the phase noise parameters over 
a frame is proposed in order to carry out the maximization step. The proposed EKFS 
based approach is combined with an iterative detector that utilizes bit interleaved coded 
modulation and employs LDPC codes to calculate the marginal a posteriori probabilities 
of the transmitted symbols, i.e., soft decisions. Numerical investigations show that for a 
wide range of phase noise variances the estimation accuracy of the proposed algorithm 



improves at every iteration. Finally, simulation results confirm that the error rate perfor- 
mance of the proposed EM-based approach is close to the scenario of perfect knowledge 
of phase noise at low-to-medium signal-to-noise ratios. 
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Introduction 



In recent years the demand for high bandwidth data services has increased with the 
evolution of the third generation (3G) and fourth generation (4G) cehular networks [1]. 
Rapid escalation in the use of bandwidth hungry devices also increases the throughput 
requirements of the base station (BS), base station controller (BSC) and master switching 
center (MSG), which are the fundamental components of a cellular network. The user 
connects to the network through the BS. Each BS is connected to a BSG via a wired 
or a wireless link. The BSC routes the data from the BS to the MSG and controls the 
functionality of the BS. The MSG holds all the network information and controls all 
calls and data management functionalities. In other words, the MSG is the brain of any 
cellular network. The portion of a wireless mobile network from the BS to the MSG is 
called as backhaul network. 

The backhaul links serves the medium to carry traffic from the BS to the MSG via the 
BSG. The point-to-point microwave radio links are commonly used in backhaul networks. 
They are cost efficient and can be deployed rapidly. Microwave radio transmission is 
operated at certain frequency bands. Lower bands such as 7, 18, 23 and 35GHz have 
better radio propagation characteristics. On the other hand, these frequency bands fail 
to provide sufficient bandwidth since the spectrum is mostly allocated. With the release 
of the E-Band, lOGHz of bandwith in the spectrum at 70GHz (71-76GHz) and 80GHz 
(81-86GHz) have been made available for point-to-point microwave links. To meet high 
data rate requirements point-to-point microwave systems are equipped with multiple 
transmit and multiple receive antennas. Line-of-sight (LOS) multi-input multi-output 
(MIMO) systems are effectively used for backhaul networking [2]. 

Local oscillators are utilized to carry the baseband signal to the operating band. 
Due to the hardware limitations, every oscillator suffers from an instability of its phase, 
resulting in phase noise [3]. Phase noise can dramatically limit the performance of a 
wireless communication system if left unaddressed [4]. Phase noise interacts with the 
transmitted symbols both at the transmitter and the receiver side in a non-linear manner 
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and significantly distorts the received signal. Digital signal processing algorithms need to 
be employed to achieve synchronous transmission in the presence of phase noise. Several 
algorithms arc proposed for single-input single-output (SISO) systems to mitigate the 
effect of time varying phase noise [5-9] . In the case of LOS-MIMO systems, each transmit 
and receive antenna is equipped with a different oscillator since the antennas are placed 
far apart. Similarly, in the case of multi-user MIMO systems or space division multiple 
access (SDMA) systems independent oscillators arc used by different users to transmit 
their data to common receiver [10]. As a result, a single oscillator cannot be employed 
and phase noise compensation algorithms proposed for SISO systems are not directly 
applicable to MIMO systems. 

1.1 Background 

Achieving channel capacity was seen far from reality until two decades ago. The in- 
troduction of turbo codes [11] and the rediscovery of low-density-parity-check (LDPC) 
codes [12] has demonstrated the power of the iterative processing paradigm in improv- 
ing the performance of communication systems and in operating close to the theoretical 
limits. Subsequently, the iterative coding structure has been applied to facilitate and 
improve many functions including synchronization. Parameter estimation can be per- 
formed jointly with data detection in an iterative fashion. It is well-known that the 
application of turbo codes and LPDC codes improves the data detection process at the 
receiver, which in turn can be applied to improve the performance of decision-directed 
estimators. The improved estimation and tracking accuracy allows for more accurate 
compensation of impairments such as time varying phase noise at the receiver which can 
also improve data detection. Thus, by jointly performing data detection and estimation, 
the performance of wireless communication systems can be significantly improved. This 
approach, known as "turbo synchronization", was initially proposed in [13] and has since 
been formalized in [14] with the use of the expectation-maximization (EM) framework 
[15]. 

In [16], different frameworks for turbo synchronization based on the gradient method 
and the sum-product algorithms are studied. This work is extended to the problem 
of estimation of time varying phase noise for SISO systems in [8]. In [8], based on 
the assumption of small phase noise values within each block and removing the data 
dependency from the observed signal, the tracking is carried out via a modified EM- 
based algorithm that applies a soft decision-directed linearized Kalman Smoother. In 
addition, to enhance phase noise tracking performance for very high phase noise vari- 
ances, [8] proposes to employ a maximum-likelihood (ML) estimator in conjunction with 
a Kalman smoother, labeled as (KS-MLA). A soft decision-directed extended Kalman 
filter-smoother (EKS) is also suggested to provide phase noise estimation. However, the 
performance of the KS-MLA degrades with increasing block length. More importantly, 
the linearization applied in [8] is not applicable to MIMO systems and the estimation 
performance of the proposed tracking algorithm is not investigated. 

MIMO technology allows communication systems to more efficiently use the avail- 
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able spectrum [17], [18]. Bit-interleaved-coded-modulation (BICM) is one of the popular 
schemes that enables communication systems to fully exploit the spectrum efficiency 
promised by MIMO technology [19, 20]. However, the performance of MIMO systems 
degrades dramatically in the presence of synchronization errors. Code-aided synchro- 
nization based on the EM framework for joint channel estimation, frequency and time 
synchronization for a BICM- MIMO system is proposed in [21]. However, in [21], the syn- 
chronization parameters are assumed to be constant and deterministic over the length 
of a block which is not a valid assumption for time varying phase noise. 

A Wiener filter approach that applies spatial correlation to improve phase noise 
estimation in MIMO systems is proposed in [22] . However, the proposed solution is only 
applicable to uncoded MIMO systems and the algorithm in [22] introduces significant 
overhead to phase noise estimation process since it requires frequent transmission of 
orthogonal pilot symbols. The problem of joint data detection and phase noise estimation 
for coded MIMO systems over block fading channels is still unaddressed and will be the 
main focus of this thesis. 

1.2 Thesis Organization 

In Chapter 2 the phase noise model is introduced and digital communication system for 
SISO systems over the additive white Gaussian noise (AWGN) channel affected by phase 
noise is presented. 

In Chapter 3 the performance of both uncoded and coded SISO systems affected 
by phase noise are investigated. The iterative code-aided EM-based approach used in 
[8] is modified and derived analytically. The EM-based algorithm is implemented and 
its components are explained in detail. Two estimators that are proposed in [8], the 
KS-MLA and the EKS, are evaluated and their performances are compared against one 
another. 

In Chapter 4, the MIMO system model for both uncoded and the coded MIMO 
systems over Rician fading channels in the presence of phase noise is described in detail. 
An iterative joint phase noise estimation and data detection algorithm based on the EM 
framework is derived analytically. A low complexity extended Kalman filter- smoother 
(EKFS) is proposed to estimate the time varying phase noise processes of each oscillator. 
BICM scheme is used to decrease the detection complexity. The performance of the 
proposed algorithm is investigated via computer simulations. 

In Chapter 5 conclusion and future research directions are discussed. 

1.3 Thesis Contributions 

The primary contributions of this thesis are summarized as follows: 

• The system model for both uncoded SISO and uncoded MIMO systems in the 
presence of phase noise are outlined in detail and an extended Kalman filter with 
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symbol-by-symbol feedback is proposed for each system. The error rate perfor- 
mance of the proposed estimators are investigated through numerical results. 

• The iterative code-aided EM-based algorithm proposed in [8] for coded SISO sys- 
tems is modified and derived analytically. Moreover, the performances of two 
estimators, the KS-MLA and the EKS, are numerically compared with the help of 
computer simulations. 

• An EM-based receiver is proposed to perform iterative joint phase noise estimation 
and data detection for BICM-MIMO systems. 

• It is analytically demonstrated that a computationally efficient EKFS can be ap- 
plied to carry out the maximization step of the EM algorithm. 

• A new low complexity soft decision-directed EKFS for tracking phase noise over 
the length of a frame is proposed and the filtering and smoothing equations are 
derived. 

• Extensive simulations are carried out for different phase noise variances to show 
that the performance of a MIMO system employing the proposed receiver structure 
is very close to the ideal case of perfect knowledge of phase noise. Simulation results 
demonstrate that error rate performances of a 2x2 LOS-MIMO system using the 
proposed EM-based receiver is very close to that of the perfectly synchronized 
system for low-to-medium signal-to-noise ratios. It is also shown that the mean 
square-error (MSE) of the phase noise estimates improves with every EM iteration. 
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Digital Communications 
with Phase Noise 



2.1 Phase Noise Modeling 

In wireless communication systems, the baseband signal is multiplied by a high frequency 
sine wave to operate at a certain frequency band, called carrier frequency. Local oscil- 
lators produce the carrier frequency waveforms. Phase-Locked Loop (PLL) [23] is the 
major phase recovery block in a communication system. PLL calculates the phase dif- 
ference between the input and the output signal. The difference is then filtered by a low 
pass filter and applied to the voltage controlled oscillator (VCO). The controlled voltage 
on the VCO changes the oscillator frequency to minimize the phase difference of the 
input and the output signal. However, the output of the VCO circuit is a non-ideal sine 
wave due to some hardware limitations. The power spectrum of the output signal is not 
strictly concentrated at the carrier frequency. The instantaneous output of a oscillator 
is given by [24] 



where fc denotes the carrier frequency, Vq denotes the amplitude, A{t) is amplitude 
noise and 6{t) is phase noise. Demir et. al. show in [3] that amplitude noise decays over 
time, since the system stabilizes itself. The amplitude noise may thus be ignored and 
the normalized oscillator output signal can be written as 



The oscillator phase noise can be seen as a widening of the spectral peak of the 
oscillator. The frequency domain single-sideband phase noise power, C{f) is defined as 
the ratio of the noise power in a IHz sideband at an offset / Hertz away from the carrier, 
PsSB, to the total signal power, Pg. 




(2.1) 



V{t) = e(^'2'^-^=*)e(-''^(*)). 



(2.2) 
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Since we have no absolute time reference, the phase disturbances accumulate over 
time and can be represented by 

0(t) = [ v{s)ds (2.3) 
Jo 

where v(t) is a white Gaussian process with a constant power spectral density (PSD). 
Then, the phase noise process can be modeled as a Wiener process and the oscillator 
power spectrum is a Lorentzian, given by [3] 

m = (2.4) 



dB 



where f^^LB denotes the 3dB bandwidth. It is seen that the spectrum is characterized by 
a single parameter, f^dB- The phase noise process is sampled every Tg seconds, sampling 
time interval. Then, the discrete time phase noise process is defined as, 

e{k) ^ 9{kTs), (2.5) 

and can be modeled as a random walk in accordance with 2.3, i.e. discrete-time Wiener 
process [3] 

e{k) = e{k-l) + I^{k). (2.6) 

In (2.6), the innovation term, A(A;) is a discrete zero-mean Gaussian random variable 
with variance a\, denoted as J\f (O, a^). The phase noise innovation variance is given 

by [3] 

<yl = 47r/3dBr,. (2.7) 
Note that the discrete innovation process is also white, 

E(A(A;)A(0) = 0,A;7^Z. (2.8) 
In Fig. 2.1 a realization of the discrete time Wiener phase noise process is plotted. 



2.1.1 Digital Communications in the Presence of Phase Noise 

At the transmitter, a group of data bits are modulated onto an M-point quadrature 
amplitude modulation (M-QAM) constellation Q, displayed in Fig. 2.2. Symbols are 
then transmitted through an AWGN channel. In a communication system without the 
phase noise disturbances the received signal at time k is given by 

y{k) = s{k)+w{k) (2.9) 

where y{k) is the received signal, s{k) is the complex transmitted symbol, w{k) is the 
zero-mean AWGN with variance <t^/2 per dimension, i.e. w{k) ^ Afc (0,a"^), as shown 
in Fig. 2.3. 
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Figure 2.2: 16-QAM constellation. 
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Figure 2.3: 16-QAM constellation affected by AWGN. 



The received signal is also effected by time varying phase noise both at transmitter 
and receiver. Let ^^(A:) and 9^^^k) denote the discrete time phase noise sample at 
transmitter and receiver, respectively. The received signal at time k is given by 

y{k) = (s(A;)e^'^'"('=) +7Z;(fc))e^'^''''('=) (2.10) 
= s(A:)e^'(^'"('=)+^"W)+^(A;) (2.11) 
= s{k)e^^^'''> +w{k) (2.12) 

where wlk) = w{k)e^^^'^^^^^ is the rotated noise sample, and e-^^^'^^ is the total phase noise 
process. Note that rotation on the circular symmetric additive noise does not change 
the statistical properties, i.e., w{k) ~ Mc (0,ct^). The innovation of total phase noise 
process will have a zero-mean Gaussian distribution and its variance will be the sum of 
the variances, A{k) ~ M ^0,cT^[t] + cr'^ir]^ where cr'^[t] and cr'^[r] denote the innovation 
variance of the phase noise process at the transmitter an at the receiver, respectively. 

The total phase noise process rotates the signal constellation as displayed in Fig 2.4. 
The received signal which is affected by the AWGN and rotated by the phase noise is 
shown in Fig. 2.5. 
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Figure 2.4: 16-QAM constellation rotated by phase noise. 
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Figure 2.5: Received signal affected by both phase noise and AWGN. 
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3 



Phase Noise Estimation 
for SISO systems 

The main focus of this thesis will be on the phase noise estimation for coded MIMO 
systems. In this chapter, to better understand the effect of phase noise, the problem 
of phase noise estimation for SISO systems over AWGN channel is investigated. It is 
assumed that perfect frame synchronization and phase recovery are performed at the 
beginning of each frame by transmitting sufficient number of pilot symbols. Therefore, 
the problem under consideration for SISO systems is simplified to the problem of phase 
noise estimation before investigating the problem for coded MIMO systems. First, an 
uncoded SISO system is taken under consideration in Sec. 3.1. An extended Kalman 
filter (EKF) is suggested to track time varying phase noise and the set of equations 
for the EKF is derived. In Sec. 3.2, the problem of joint phase noise estimation and 
detection for a coded SISO system is discussed. An algorithm is analytically derived from 
the EM framework and is applied to iteratively solve the problem. The enhancement 
of the LDPC codes and the Kalman filters into the EM-based algorithm is explained in 
detail. 

3.1 Uncoded SISO 

In order to de-rotate the signal space and to achieve synchronous communication, time 
varying phase noise process should be estimated. Since the parameter to be estimated is 
not deterministic, an estimator based on the Bayesian approach should be used [25]. In 
the Bayesian approach, prior knowledge about the random parameter is also taken into 
account. This approach is commonly used for the systems which can be represented with 
a dynamical model. Kalman filtering can be considered as a sequential minimum mean 
square error (MMSE) estimator which works according to the Bayesian framework. 
The received signal in (2.12) and the phase noise process are used to construct a 
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CHAPTER 3. PHASE NOISE ESTIMATION 

FOR SISO SYSTEMS 



state space signal model. The state and observation equations at time k are given as 



where y{k) is the received signal, s{k) is the complex transmitted symbol belonging to 
the M-QAM constellation, 9(k) is the phase noise value, w{k) is the additive complex 
Gaussian noise with variance cr^ and A(fc) is the phase noise innovation, which is assumed 
to be Gaussian distributed with variance a\. Since the observation equation is nonlinear, 
a hard decision-directed EKF is used instead [25]. The observation equation can be 
rewritten as 



In (3.4), s{k) is the hard decision of the transmitted symbol at time instance k. Note that 
for uncoded SISO systems hard decision symbol, s{k), is obtained by the demodulator 
at each time instance. Next, s{k) is input to the hard decision-directed EKF at each 
time instance. In other words, decision feedback is performed symbol-by-symbol. The 
EKF provides phase noise estimate, 9{k). 

3.1.1 The Extended Kalman Filter 

The EKF first predicts the mean and the minimum prediction MSE of the state ahead, 
9 {k\k — 1) and P{k\k — 1), respectively, given the previous values. Then, the EKF up- 
dates the estimates with the observation and computes the mean and the minimum MSE 
of a posteriori state estimate, 9{k\k) and P{k\k), respectively. The Kalman gain, K(k), 
indicates the amount of correction required for an observation sample. Since z{9{k)) is 
a nonlinear function, it is linearized with a first-order Taylor expansion. Therefore, z{k) 
denotes the Jacobian of z{9{k)) with respect to 9. 

The first and the second moments of the state ahead are predicted as 



State: 9{k) = 9(k - I) + A{k), 
Observation: y{k) = s{k)e^^^^^ + w{k) 



(3.1) 
(3.2) 



y{k) = z{9{k)) + w{k) 



(3.3) 



where the nonlinear function z{.) is defined as 

z{9{k)) = s(fc)e^'^W. 



(3.4) 



9{k\k-l) = 9{k-l\k-l) 
P{k\k-1) = P{k - l\k - 1) + al. 



(3.5) 
(3.6) 



After the observation, the posteriori state estimate statistics are updated as 



9{k\k) 
P{k\k) 



9{k\k - 1) + ^{K{k){y{k) - z{9{k\k - 1)))} 
{1 - ^{K{k)z{k)})P{k\k - 1), 



(3.7) 
(3.8) 



where the Kalman gain is determined as 




(3.9) 
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the Jacobian of z with respect to 9 is given by 

dz{9{k)) 



de{k) 



e{k\k-l) 



jz{eik)). 



In (3.9), C is the observation noise variance, given by 

C 



2 2 



(3.10) 



(3.11) 



The EKF needs to be properly initiahzed to compute ^(1|0) and the MSE P(1|0). 
It is assumed that a sufficient number of pilots is used for frequency, frame and phase 
synchronization at the beginning of the frame. Therefore, there is no phase shift of the 
first received signal i.e. ^(1|0) = 0. Moreover, at the first time instant, the minimum 
prediction MSE is set to P(1|0) = a\ since this error amounts to the estimation of ^(0|0) 
without any data. 

The EKF is applied for different phase noise innovation variance values. The bit error 
rate (BER) performance of the system is investigated. BER vs. Eh/No for 16-QAM is 
shown in Fig. 3.1. It can be seen that as Eb/No increases, the EKF performs better and 
can track phase noise processes with higher variances. 




Figure 3.1: BER vs. Eb/No for 16-QAM for various values of a]^. 
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Figure 3.2: BER vs. Eh/No for 16-QAM uncoded and coded system without phase noise 



3.2 Coded SISO 

In coded SISO systems, the data bits are first encoded with an LDPC encoder. Then, 
the encoded bits are modulated onto complex symbols from an M-QAM constellation 
A4 and transmitted through the AWGN channel. The phase noise process should be 
estimated in order to de-rotate the signal space. 

Channel coding adds redundant bits to protect information bits and to correct erro- 
neous bits. A rate R = 7/8 regular LDPC encoder from the NASA Goddard technical 
standard [26] is used. It is a regular code with variable node degree 4 and check node 
degree 32. The BER vs. Eh/No for both uncoded and coded systems without phase 
noise is shown in Fig. 3.2. Data bits are mapped to 16-QAM symbols. As expected, 
very low BERs can be achieved with channel coding at medium and high E^/Nq levels. 

In a coded SISO system in the presence of phase noise, decoding and phase noise 
estimation can be performed jointly in an iterative way to complement one another. The 
EM framework is used in [16] to estimate the constant phase offset. In [8], a modified 
EM-based algorithm is suggested to estimate time varying phase noise. The tracking 
is performed by both an extended Kalman filter and smoother (EKS) and a linearized 
Kalman filter and smoother with maximum-likelihood average (KS-MLA). The MLA 
algorithm removes the phase noise average over the frame. In [8], the modified EM-based 
algorithm is not derived analytically. In the following, we demonstrate analytically how 
an EM-based algorithm can be utilized for code-aided synchronization. The performance 
of the proposed estimators is investigated numerically. 



15 



3.2. CODED SISO 



CHAPTER 3. PHASE NOISE ESTIMATION 

FOR SISO SYSTEMS 



First, recall that the signal model and the phase noise model for the uncoded SISO 
system is given by 

0{k) = 9{k-l) + A{k) 
y{k) = s{k)e^'^'^^'> +w{k). 

Let L f denote the number of symbols in one frame. We define the vectors 

y ^ [y{l),y{^),...,y{Lf)f (3.12) 

s 4 [sil),si2),...,siLf)f (3.13) 

e ^ [e{i),e{2),...,e{Lf)f. {s.u) 

Given the observation vector, y, the maximum a posteriori (MAP) estimate of 6 is 
given by 

e = argmaxlnp(y|0) + lnp(0) (3.15) 



where p(y|0) = ^p(s)p(y|s, 0) is the a priori probability of parameters 0. 

s 

The EM framework is an iterative approach to solve an estimation problem where 
the observation, y, depends not only on the parameter to be estimated, 0, but also 
on some nuisance parameter, s. Note that transmitted symbols, s, and phase noise 6 
are independent. The EM algorithm iteratively maximizes the conditional a posteriori 
expectation, £^s| \np{y\s,0)\-y,9^^ l'^P(^)) where ln/(y|s,§) is the conditional log 

likelihood function (LLF) and E{.} denotes the expectation operator. In the expectation 

(i-l) 

step the block of previous phase noise estimates, 9 , is kept fixed and it is updated 

in the maximization step. 

The EM framework for the ith iteration is defined by [16] 

Expectation step: Q(e\e^'~^^^ = E^^ lnp(y|s,0)|y,0^*^^^} + lnp(6>) (3.16) 

Maximization step: 6^^ = axg max. ^Q^0\6^ (3-17) 

The EM algorithm has been shown to converge to the MAP solution if it is accurately 
initialized. 



3.2.1 Expectation Step (E-Step) 

Given the transmitted data and the phase noise process, the received signal has a Gaus- 
sian distribution. After taking logarithm and dropping constant terms, the conditional 
LLF is given by 

lnp(y|s,0) a -2SR^y(A;)s*(A;)e-^'^W. (3.18) 

k=l 
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Taking the conditional expectation over s, given y and , equation for the expecta- 
tion step can be written as 

Q{e\e^' =-2SR^a(A;)*y(A;)e^'^('=)+lnp(6l), (3.19) 

k=l 

where the weighted or soft symbol a{k) is defined as 

a{k) ^ J2 ""IP (^w = ^^"'0 • ^^-^^^ 

ai&M 

In (3.20), p{s{k) = aily, 6 ) are the marginal a posteriori symbol probabilities (APPs) 
of the transmitted symbol. For 16-QAM, if Gray mapping is used, (3.20) can be com- 
puted as 

a{k) = Pi{k){2 - p2ik)) - jl33{k)i2 - p^{k)), (3.21) 

where 

/3i{k) = tanh (3.22) 

and Li{k) is the log likelihood ratio (LLR) of the a posteriori probability of the i th bit 
of the symbol at time instant k, bi{k). The LLR is defined as 

- (j-i) 

Li{k) = log TT— IT- (3-23) 

p{h{k) = 0\y,e^ ^) 

The block diagram of the receiver structure is shown in Fig. 3.3 where superscript 
(i) denotes the iteration of the EM algorithm. The LLRs are first computed by a soft 
demapper (demodulator). Then, they are passed to the LDPC decoder. Next, the LDPC 
decoder runs a sufficient number of iterations to achieve more accurate LLRs. After that, 
the LLRs computed by the LDPC decoder are modulated into soft symbols according to 
(3.21) by a soft mapper. As a result, the expectation step computes the block of APPs 
denoted as 

a ^ [a{l),a{2),...,a{Lf)f. (3.24) 



3.2.2 Maximization Step (M-Step) 

The maximization step maximizes in (3.17) with respect to 0. Since the 

system can be modeled in a state-space form, the solution can be given by Kalman 
filtering. The Kalman filter is an optimal MMSE estimator which can be considered as 
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Figure 3.3: Block diagram of the receiver structure for coded SISO system. 



a MAP estimator [25]. Then, a decision directed Kalman filter where the transmitted 
symbol vector, s, is replaced by the soft decision symbol vector, a, estimates as 

6 = arg maxln p{y\9, s = a) + lnp{6). (3.25) 


By setting s = a, the conditional LLF in (3.18) can be rewritten as 

lnp(s|s = Q,6>) cc 2K^y(A:)a*(A;)e-^'^(^). (3.26) 

k=l 

Using (3.26) in (3.25) we achieve (3.19) which is the function to be maximized in the 
M-step. As a result, a decision directed Kalman filter can be used to carry the M-step. 

In [8], two soft decision-directed Kalman filters, the KS-MLA and the EKS, are 
proposed. In the following, two estimators will be explained. 

The Kalman Filter and Smoother with Maximum Likelihood Average 

The KS-MLA proposes a new observation equation which is a linear function of 9. As- 
suming that a{k) = s{k), the KS-MLA first removes the data dependency from the 
measurement via 

eik) = Im{y{k)a*{k)} (3.27) 
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where e{k) is the new observation equation. Then, the KS-MLA assumes that the phase 
noise values are small enough such that 

sin 6* « 9 (3.28) 

cos 61 K 1. (3.29) 

Subsequently, new observation equation is given by 

e{k) = Q{y{k)}^{a{k)} - ^{y{k)}Q{a{k)} (3.30) 

= u{k)9{k) + v{k), (3.31) 



where 



and 



u{k) = ^{sik)}^{a{k)} + Q{s{k)}Q{a{k)} (3.32) 
= II a{k) f , (3.33) 



v{k) = ^{a{k)}Q{w{k)} + Q{a{k)}^{w{k)}, (3.34) 



is a zero mean Gaussian random variable with variance = Es(j'^/2 and Es is the 
average symbol energy. Since the observation equation is linear, a regular Kalman filter 
and smoother (KS) can be used. Note that the new observation equation does not 
depend on the complex transmitted symbol. Instead, it is a function of the amplitude 
square of the soft symbol. 

Phase noise process reaches large values within a block. Depending on a\ and Lj, 
it has a nonzero average over the block. The MLA algorithm estimates the ML average 
of the phase noise process over each block and removes it from each received block, y, 
at the input of KS. Then, the parameter to be estimated is given by 

^(fc) = e{k)-9avg (3.35) 

where 

Ns 

9avg = aTg'^y{k)a{k)*. (3.36) 
k=l 

The MLA algorithm is directly embedded into the EM framework and performed before 
the estimator in the M-step. 

Extended Kalman Filter and Smoother 

Second estimator proposed in [8] is the soft decision-directed EKS. The observation 
equation in (3.2) is a nonlinear function of 9. Therefore, a suboptimal decision directed 
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EKS is used to track the phase noise process in [8] . The state and observation equations 
at time k are given as 

State: 9{k) = e{k - 1) + A(fc) (3.37) 
Observation: y{k) = a{k)e^^^^^ + wik). (3.38) 

Note that (3.2) and (3.38) are similar. We can rewrite the observation equation as 

y{k) = zc{0{k)) + wik), (3.39) 

where Zc stands for the nonhnear function for the coded system. The EKS approximates 

clS 

(JZ 

« zMk\k - 1)) + ^ " ^^^'^ " ^^-^^^ 

where 9{k\k — 1) is the estimate of d{k) based on the previous data. 

The EKS first filters the received signal and estimates the block of parameters. Af- 
terwards, it smooths the estimations with a backward recursion. It is initialized with 
state estimate ^(1|0) = and a posteriori MSE -P(1|0) = a\. The filtering equations 
compute d{k) and P{k),k = 2,3,..., Ng in a recursive fashion according to (3.5-3.11) 
where z{0{k)) is replaced by Zc{0{k)). 

The smoother runs a backward recursion to find better estimates of the parameter 
block. We will use subscript s to refer to smoothing. /c+ denotes the sequence from k to 
Lf. The set of equations for smoothing are given by 

e,{k\k-^) = e{k\k) + p{k\k)p{k + i\k)-^{es{k + i\k + i+)-e{k\k)) (3.41) 

Ps{k\k+) = P{k\k) + P{k\k)P{k + l\k)-^ 

x{Ps{k + l\k + 1+) - P{k + l\k)){P{k\k)P{k + l|A:)-^)^(3.42) 

3.2.3 LDPC decoder 

LDPC codes are linear block codes that have a sparse parity check matrix Hp. The 
input of the LDPC decoder are the LLRs that are computed by the soft demapper 
(demodulator). The output of the LDPC decoder are the updated LLRs that will be 
used by the soft mapper (modulator). 

An example of a parity check matrix of a (7,4) irregular block code, i.e. the number 
of I's in each row and in each column is not constant, is given by 



Hp 



1110 10 
10 110 10 
110 10 1 



(3.43) 



The corresponding Tanner graph is shown in Fig. 3.4. There are 7 variable nodes and 4 
check nodes for Hp. Let k = 1,2,3 an / = 1,2, ... ,7 be the index of the rows and columns 
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of Hp, respectively. If Hp[k,l] is 1, then there exists a connection between the check node 
k and the variable node /. Note that the information exchange is done in two ways for 
each connection, one from variable node to check node and one for the check node to 
variable node. 

Ci C2 Cs C4 C5 C6 C7 



Variable Nodes 




Check Nodes 



Figure 3.4: Tanner graph for Hp in (3.43). 



The LDPC decoder runs the smn product algorithm to estimate the LLRs of the 
transmitted bits. It computes the LLR of each path from variable nodes to check nodes, 
and from check nodes to variable nodes iteratively. L{ci) denotes the LLR of the Ith. bit 
of the transmitted codeword c. Let L{rki) denote the LLR that belongs to the connection 
in the direction of check node k to variable node I. Similarly, L{qik) denotes the LLR 
of the same connection in the opposite direction. An example is also shown in Fig. 3.4. 
L{Qi) denotes the updated LLR of the Ith bit of the transmitted codeword. The sum 
product algorithm is performed as follows 

L{rki) = 2atanh JJ tanh (^L(gi/fc)) , (3.44) 

L{qik) = L{ci)+ ^ L{rkn), (3.45) 

L{Qi) = L{ci)+ L{rk'i), (3.46) 

where V/^y represents the set of indexes of all the variable nodes connected to the check 
node k except for the variable node I. Similarly, C;^^ represents the set of indexes of 
all the check nodes connected to the variable node I except for the check node k. For 
example, ii k = 2 and / = 4, V2\4 = {1,3,6}, C4 = {2,3} and 6*4^2 = {3}. 

Improving the speed of the algorithm 

L{qik) should be initialized for the first iteration. Normally, it is initialized with the 
input LLRs as 

L{qik) = L{ci). (3.47) 
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As suggested in [16], instead of initializing with the input LLRs, L{qik) is initiahzed 
by the last update of it from the latest EM algorithm iteration. Thus, 

L{qik) = L{qikf-^^ (3.48) 

where (i) denotes the algorithm iteration. It is seen that significant complexity reduction 
can be achieved with negligible degradation in BER with this approximate version. The 
number of the decoder iterations can be reduced and the number of the EM algorithm 
iterations can be increased. Since the complexity heavily depends on the number of 
decoder iterations, the overall complexity is much less than that of the original EM- 
based algorithm. 

3.2.4 Simulation Results 

First, the advantage of keeping internal information at the decoder is investigated for 
the 256-QAM system with the EKS. In Fig. 3.5, the BER is calculated for each EM 

iteration for diff'erent number of decoding iterations with and without keeping internal 
information at the decoder for a fixed Eh/No = 16dB. The dashed lines represent the 
algorithm where the LDPC decoder is reinitialized between each iteration of the EM 
algorithm. In Fig. 3.5, the solid lines represent the new algorithm where the internal 
information in the LDPC decoder is kept between the EM algorithm iterations. It is 
seen that with keeping internal information overall complexity can be reduced due to 
fewer iterations. When the LDPC decoder is reinitialized the BER tends to reach a fioor 
and the system cannot perform under this level even with more EM iterations. On the 
other hand, when we keep the internal information at the LDPC decoder, lower BERs 
can be achieved with increasing number of EM iterations since better LLRs are obtained 
from the decoder in each EM iteration. 

In Fig. 3.6, the results of the EM algorithm are shown for different number of 
iterations for both the EKS and the KS-MLA for a 16-QAM system where a\ = 10~^. 
The number of iterations performed by the LDPC decoder is set to 3. It is seen that the 
KS-MLA performs slightly better than the EKS. 

The KS-MLA suggests a new linear observation equation (3.31) by assuming a{k) = 
s{k). Moreover, the received signal is multiplied by the soft decision symbol which also 
increases the noise power. This ad hoc method is proposed in [8] to alleviate the effects 
of the assumptions in (3.28) and (3.29). When the phase noise values are small, a{k) is a 
reliable estimate of s{k). Then, the KS-MLA algorithm performs better than the EKS. 
However, the KS-MLA fails to track more severe phase noise processes. In Fig. 3.7, the 
phase noise innovation variance is set to = 3 • 10^^ where all the other parameters 
remain unchanged. It is concluded that the assumptions (3.28) and (3.29) are violated 
and a{k) is a less reliable estimate of s{k). Thus, the KFS-MLA performs significantly 
worse than the EKS. Moreover, the KS-MLA has an irreducible error floor. 

In Fig. 3.8, the results for both the EKS and the KS-MLA are shown for a 256-QAM 
system where = 10~^. It is well-known that the reliability of the estimate of a 256- 
QAM symbol is less than that of a 16-QAM symbol for the same phase noise process. 
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Figure 3.5: BER vs. the EM algorithm iterations for 256-QAM coded system with EKS at 
Eb/No — 16dB for different number of decoder iterations, with and without keeping internal 
decoder information. 



The reason is that phase noise effects the outer symbols in the signal constellation. In 
addition, the 256-QAM constellation is more densely packed than the 16-QAM constel- 
lation, i.e., the distance and the phase difference between two neighbor constellation 
points is smaller. Therefore, the performance of the KS-MLA is degraded since the noise 
power is also amplified. In Fig. 3.8, we observe that the EKS performs better than the 
KS-MLA. As a result, the EKS is more advantageous than the KS-MLA for higher order 
modulations. 
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E^/N„[dB] 



Figure 3.6: BER vs. Et/No for 16-QAM coded system with both the EKS and the KS- 
MLA where cr^ = 10^^ and 3 decoding iteration. 




E,/N„[dBI 



Figure 3.7: BER vs. Et/No for 16-QAM coded system with both the EKS and the KS- 
MLA where cr^ = 3 • 10^'* and 3 decoding iteration. 
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4 



Phase Noise Estimation 
for MIMO systems 



The demand for high data rate wireless communications has spearheaded the research 
in the field of MIMO systems. It is shown that the bandwidth efficiency of a wireless 
link can be significantly improved with the usage of MIMO systems [17, 18]. However, 
synchronization errors decrease the performance of MIMO system dramatically. In Sec. 
4.1 the system model for an Nf x Nr uncoded MIMO systems is introduced. Detection 
in MIMO systems is also briefiy discussed. An EKF is applied to track multiple phase 
noise processes. In Sec. 4.2, the main contribution of this thesis is provided. Joint phase 
noise estimation and detection in coded MIMO systems is performed with the help of 
an EM-based algorithm for the first time in the literature. Exploiting LDPC codes, 
EKFS and BICM, the proposed EM-based algorithm iteratively solves the problem of 
joint phase noise estimation and detection. Simulation results are also evaluated for a 
2x2 LOS-MIMO system over Rician fading MIMO channels. 

4.1 Uncoded MIMO 

An uncoded MIMO system with Nt transmit and Nr receive antennas is under con- 
sideration. At the transmitter, a group of data bits are modulated onto an M-QAM 

constellation Q. They are demultiplexed into substreams of symbols of length Lf. Sub- 
sequently, using spatial multiplexing the symbols are transmitted simultaneously from 
Nf antennas. Quasi-static block fading channels are considered, i.e., the channel gains 
remain constant over the length of a frame but change from frame to frame. Similar to 
previous work in the literature [22], it is assumed that the Nr x Nt channel matrix H 
is estimated using orthogonal training sequences that arc transmitted at the beginning 
of each frame. To ensure that the proposed scheme is applicable to LoS and multi-user 
MIMO systems, it is assumed that independent oscillators are deployed at each transmit 
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and receive antenna. AWGN is also taken into consideration. The received signal is also 
effected by time varying phase noise both at the transmitter and the receiver side. To 

ensure that the proposed scheme is applicable to LoS and multi-user MIMO systems, it is 
assumed that independent oscillators are deployed at each transmit and receive antenna. 

The performance of the uncoded MIMO system is severely degraded in the presence 
of phase noise. In [22], pilot-aided estimation of phase noise in an uncoded MIMO 
system is investigated. The phase noise parameters corresponding to the transmit and 
receive antennas are estimated by applying a Wiener filtering approach. However, the 
proposed scheme is bandwidth inefficient and significant overhead is introduced. In [27], 
joint channel and phase noise estimation is performed. A data aided least square (LS) 
estimator, a decision directed weighted least squares (WLS) estimator and a decision 
directed EKF are proposed to track time varying phase noise. 

Based on the above set of assumptions, the received signal at time instance k, y{k) = 
[yi{k),y2{k), . . ■,yNr{k)f, is given by 

y{k) =rM(fc)HrW(fc)s(fc) + w(A;) (4.1) 

where 

• rM(fc) = diag(^eM'''(fe),eM'''(fe),...,e-''^^l-('=)) is an Mr x Nr diagonal matrix and 

rW(/c) = diag(^e-?'^i*'('=),e^'4"(^), . . . ,e^'^^^V^^'^ is an A^* x Nt diagonal matrix, 

• 0^^^ (k) and 9m {k) denote the phase noise process at the £th receive and mtli trans- 
mit antennas, respectively, where the Nr x Nt MIMO channel matrix is denoted 
as H = [hi, h2, . . . , HatJ with = [he^i, hi^2, he^Nt]^ 

• hi^mi for I = 1,2, . . . ,Nr and m = 1,2, . . . ,Nt, denotes the channel gain between 
transmit antenna m and receive antenna i that is modeled as a complex Gaussian 
random variable, CM{fih^^i, crl^ J 

• s{k) = [si{k), S2{k),. . . , SNt{k)]^ is the vector of transmitted symbols, 

• w(A;) = [wi{k),W2{k), . . . , 'Wj^^{k)]^ is the vector of zero-mean additive white Gaus- 
sian noise (AWGN), CAfiO,alJ. 

Phase noise is modeled as discrete-time Wiener process. Therefore, for £ = 1,2, . . . ,Nr 
and m = 1,2, . . . ,Nt [3] 

ePik) =eP{k-i) + 4\k) 

0W(fc)=eW(fe-l) + AW(fc), (4.2) 

where A^^\k) and Am{k) are the phase innovations for the ith receiver and mth trans- 
mit antenna, respectively. They are assumed to be white real Gaussian processes with 
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A^Pik) ~ MiO,a^ and A^ik) ~ M{0,a^ ^t])- Let us define Oik) as 



eik)^y;\k),...,9^;,\ik),9f\k),...,e%{k) 



(4.3) 



Then we have 



e{k) =e{k - 1) + A(A;) 



(4.4) 



where A(fc) ^ W{k), (fc), (A:), . . . , A%{k) 



4.1.1 MIMO detection 

We want to detect the transmitted symbol vector s(A;) in the maximum-Hkehhood (ML) 
sense. For an M-QAM modulated Nt x Nr MIMO system, ML detection of the trans- 
mitted symbol vector at time instant k is given by 

s(A;) = arg max 11 y — f(s, 0(A:),H) 11 (4.5) 

where 

f (s, e{k),U.) ^ rM (A;)HrM (A;)s. (4.6) 

The ML detection search over M^' combinations, Si,i = 1,2, . . . ,M^*, of the transmitted 
symbol vector. The problem in (4.5) is computationally infeasible especially for higher 
order modulations. There are several detectors that provide approximate solutions with 
low complexity, such as zero-forcing detection with decision feedback [28, 29], sphere 
detection [30, 31], and lattice reduction aided detection [32, 33]. However, low complexity 
MIMO detection algorithms are beyond the scope of this thesis. The ML detection 
problem in (4.5) is directly solved by searching over all possible transmitted symbol 
vectors. 



4.1.2 The Extended Kalman Filter 

The ML detector provides hard decision symbol vector, s{k). Next, s{k) is input to the 
EKF which estimates phase noise vector, 0{k). A hard decision directed EKF is applied 
to estimate phase noise parameters. Let us define X(A;) = T^'^\k)HT^^\k) . Consequently, 
the vector of received signals at the receive antennas at time k, y{k) can be rewritten as 

y{k) = X{k)s{k) + w{k) (4.7) 
« X{k)s{k) + w{k). (4.8) 

It can be seen from (4.4) and (4.8) that there are a total of A^^ -|- Nt phase noise 

processes that need to be tracked. However, as shown below, an equivalent signal model 
can be obtained that reduces the dimensionality of the estimation problem and results 
in reduces overhead and improved estimation accuracy [27]. 
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By arbitrarily selecting the phase noise process 9^^^{k) as a reference phase noise 



value, X(A;) in (4.26) can be rewritten as 

X(fe) = e^«('=))rM(fc)HrM(fc)e-^'«('=)) 



t^''\k)Ht^^\k), (4.9) 



where 

• f '*'(A;) = diag|e-'('^^-+iW\ . . , ^e^i4>Nr+Nt-iik)) ^ 

• (t>{k) = IM^)^ ■ ■ ■ ,(l>Nr+Nt-i{k)f , and 




,Nr + Nt 



It is seen that Nr + Nt state parameters can be replaced to Nr + Nt — 1 new state 
parameters without changing the observation equalities. Then, we can rewrite the state 
and observation equations at time k as 

<j){k) = (t>{k - 1) + A{k) (4.10) 
y{k) = z(0(fc)) + w(fc), (4.11) 

where 

Z(0(fc)) ^ [zi{cl>{k)),Z2{(t>{k)),---,ZNMk))f, 

= f''^'(A;)Hf'*'(A:)s(A;), 

and Zjn{4>{k)) , m = 1,2, . . . ,Nr, denotes the mth element of vector z{cf){k)). Note that 
we assume that H is known, s{k) is provided by the detector and Zm{<P{k)) is a nonlinear 
function of 0(fc). 

It is assumed that perfect phase synchronization is obtained at the beginning of a 
frame by transmitting sufficient number of pilots. Then, the EKF is initialized with the 
state estimate 0(0) = and the error covariance estimate M(0) = a'jj.. The EKF first 

estimates the a priori state vector (k), and the {Nj. + Nf — l) x {Nj. + Nf — l) a priori 
error covariance matrix M (k) as follows 

(f)'{k) = cl){k-l) (4.12) 
M"(A;) = M{k) + 2all. (4.13) 

Next, the EKF linearizes the nonlinear function z[(f)(k)) in (4.11) about the a priori 
estimate of the state vector using a first-order Taylor approximation as 

z(0(fc)) « z{^-{k)) + Z{k){cPik)-cP~{k)) (4.14) 
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where the Nr x {Nr + Nt — I) Jacobian matrix with respect to 4> at time instance k, 
Z{k), is defined as 

The Jacobian matrix can be constructed with two matrices as 

Z{k) = [Zi{k),Z2{k)] (4.16) 
where the Nr x Nr matrix Zi{k) is defined as 

Z,{k) ^ dmg{jzii^''{k)),...,jzNA^~{k))] (4.17) 
and the Nr x (Nt — 1) matrix Z2{k) is given by 



Mk)^ 



j/i2ie^'^2 (*=)si(A;)e^'*~r+i(*=) . . . j/i2(iv«-i)e^'^2 «Siv,-i(A;)e^'^^-+^t-i^''^ 

jhN^ie^^''r^''hi{k)e>^^r+ii''') . . . jhN,^Nt-i)e'^~^-^''hNt-i{k)e^^^r+Nt-iik) _ 

(4.18) 

After the observation, the a posteriori estimate of the state vector, (f>{k), and the 
error covariance matrix, M(fe), are given by 

4>{k) = ^~{k) + ^{K{k){yik)~zi^~{k)))} (4.19) 

M{k) = (l-^{K{k)Z{k)}^M~{k), (4.20) 

where the {Nr + Nt — 1) x Nr Kalman Gain matrix, K(A;), is given by 

K(fc) = M'{k)Z{k)"(c^ + Z{k)M'{k)Z{k)^y\ (4.21) 
Finally, the observation noise covariance matrix is given by 

= (4-22) 

4.1.3 Simulation Results 

BER vs. Eb/No for BPSK modulation and ML equalization for a 2x2 MIMO system 
where Lf = 1000 is shown in Fig. 4.1. It is seen that the EKF performs close to 
the synchronized system at low to medium E[j/Nq levels where o"^ = 10 ^. On the 
other hand, the BER performance of the system degrades at high Ef,/No levels. Note 
that the number of parameters to be tracked by the EKF is larger than the number of 
observation equations. This results in an error floor, i.e. the performance of the system 
cannot be improved with increasing Eb/No. The error floor depends on the phase noise 
innovation variance, aj^. In Fig. 4.1 wc observe that error floor tends to occur at lower 
signal-to-ratios for the system with cr^ = 10 ^ . 
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Figure 4.1: BER vs. £^6/^0 for 2x2 uncoded MIMO system with BPSK modulation for 
various values. 



4.2 Coded MIMO 

MIMO systems can utilize the available spectrum more efficiently [17], [18]. A number 
of coding structures have been proposed in order to achieve high spectral efficiency, 
including multi-dimensional trellis-coded modulation [34], space time block codes [35], 
MIMO multilevel coding [36]. BICM is also one of the popular scheme that enables 
communication systems to fully exploit the spectrum efficiently [19, 20, 37]. 

Code-aided synchronization based on the EM framework for joint channel estima- 
tion, frequency and time synchronization for a BICM-MIMO system is proposed in [21]. 
However, in [21], the synchronization parameters are assumed to be constant and de- 
terministic over the length of a block, which is not a valid assumption for time varying 
phase noise. In the following, we show analytically how an EM-based algorithm with a 
soft decision-directed EKFS can be used to estimate and compensate time varying phase 
noise. 

First, we recall the signal model for uncoded MIMO systems. The received signal at 
time instance k is given by, 

y{k) = rM(A;)HrW(A;)s(A;) + w(A;) 
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and the new state vector of length Nt + Nr — 1 can be written as 

4>{k) = (f){k-l) + A{k). 

4.2.1 The EM algorithm 

The EM algorithm iteratively solves an estimation problem where the observation, 
r^]NrxLf — [y(l)'y(2)) • • • !y(-^/)]) depends not only on the parameters to be esti- 
mated, [®](^i\ir+Nt)xLf — ■ • ■ ^^{L'f)]-! but also on some unknown parameters, 
[S]iv,xL, = Kl),s(2),...,s(^/)] [15]. 

Given the observation sequence Y, the MAP estimate of © is given by [25] 

© = arg max In p{Y\&) + lnp{&) (4.23) 

where p(Y|0) = ^p(S)p(Y|S, ©). 
s 

The EM algorithm consists of the expectation step (E-step) and maximization step 
(M-step) [16]. For the ith EM iteration, the E-step and M-step equations are given by 

q(0|©^^"'^) ^ Eg|^_^(,_i){lnp(Y|S,e)}+lnp(0), (4.24) 
0^'^ = argmaxjQ^©!©^*"^^)}, (4.25) 

respectively. The EM algorithm converges to the MAP solution if the initial estimates of 
the parameters of interest, b^*^), are sufficiently close to the true values of the parameters. 
Otherwise, the EM algorithm may converge to a saddle point or a local maximum. To 
ensure the convergence, pilot symbols are inserted into the data stream every pr time 
instances. 

In the following subsections we derive the E-step and M-step of the EM algorithm 
for coded MIMO systems. 

4.2.2 E-step 

Let us define X(A;) = r['"l(A;)HrW(A;). Consequently, the vector of received signals at the 
receive antennas at time k, y{k) can be rewritten as 

y{k) =X{k)s{k) + w{k). (4.26) 
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According to (4.26), the LLF of the received signal matrix, Y, given the transmitted 
data, S, and the phase noise process, 0, is given by 

lnp(Y|S, 0) a - ^ II y{k) - X{k)s{k) \\ 

k=l 
Lf 

a25R^tr(y(A:)s^(A:)X^(A;)) 
k=l 

Lf 

-^tv(x{k)s{k)s"{k)X"{k)y (4.27) 
k=l 

Using (4.27) in (4.24) the E-step of the EM algorithm can be determined as 

q(0|0^' ^'^ =2K^tr(y(A:)a^(fc)X^(A;)) 
k=l 

-^tr(^X(fc)B(A;)X^(fe)) +lnp(0), (4.28) 
fe=i 

where 

• oc{k) = 'Es{s{k)} = ^ anp(s(fc) = anjY,©''* ^'*) and 

• B(fc)^E,{s(fc)s^(fc)} =5]a„a^p(s(A;) = a„|Y,0^*"'^). 

In (4.28), a{k) denotes the marginal posterior mean of the coded symbol vector at time 

- (j-i) 

instance k, p{s{k) = a„|Y,0 ) denotes the APPs of the coded symbol vector given 

Y and , and B(A;) is an {Nt x iVj) matrix. As a result, the E-step reduces to the 
computation of the APPs. Note that the APPs can be computed via an iterative MAP 
decoder which is outlined in Section 4.2.5. 

4.2.3 M-Step 

As shown in (4.25), the M-step maximizes the E-step with respect to the parameter of 
interest, 0. In the following, it is shown that a low complexity soft decision-directed 
EKFS can be used to carry out the M-step of the EM algorithm. 

Note that a Kalman filter is equivalent to a MAP estimator [25]. As a result, the 
Kalman filter estimates of 0, can be written as 

=arg,m|x{lnp(Y|0,S = A) + lnp(0)} (4.29) 

where A = [a(l), cx{2), . . . ,cx{Lf)] is an Nt x Lf matrix. 
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By setting S = A, (4.27) can be rewritten as 

/ 

lnp(Y|S = A,e) o:2^^tv(y{k)a" {k)X^ (k) 

k=l 

Lf 

- ^tr(x(fc)a(fc)a^(A;)X^(fc)) 
k=l 

+ lnp(0). (4.30) 

Note that (4.30) and the E-step equation in (4.28) are equivalent to one another except 

for the term ^ tr (|x(A;)a(A;)a^(A;)X^(fe)) . However, when the soft decisions reach 
fe=i 

their true values, we can assume that a{k)a^{k) B(A;). Thus, using (4.29) and 
(4.30), we can conclude that a Kalman filter can be applied to carry out the M-step of 
the EM algorithm. 

Note that the observation equation for the Kalman filter is given by (4.26) while 
based on (4.2), the state equation at time k is given by 

e{k)=e{k-l) + A{k), (4.31) 

r 1 T 

where A(A;) ^ Af ^ (it) , . . . , A^^;^ (A;) , Af ' (A;) , . . . , aJJ^ {k) . The transmitted symbols 

s(k), can be replaced by their a posteriori means, i.e., soft decisions cx{k) computed 
at the E-stcp using the iterative MAP detector in Section 4.2.5. Subsequently, the 
observation equation in (4.26) can be rewritten as 

y{k)^ X(fe)a(fe) +w(A). (4.32) 

Since the observations are a nonlinear function of the parameters of interest, 0^, an 
extended Kalman filter-smoother needs to be used instead to carry out the M-step of the 
EM algorithm [25]. 



4.2.4 The Extended Kalman Filter-Smoother 

Note that (4.8) and (4.32) are similar. We can rewrite the observation equation for the 
coded MIMO system as 

y{k) = zMk)) + w{k). (4.33) 

The EKFS first filters the received signal and provides phase noise estimates with a 
forward recursion over the frame. The filtering equations compute the posteriori estimate 
of the state vector, ^^(fc), and the error covariance matrix, M^(fe), k = 2,3, ■ ■ ■ ,Lf in a 
recursive fashion according to (4.12-4.20) where z{(f){k)) is replaced by Zc{cf){k)). In other 
words, instead of the hard decision vector provided by the ML detector in the uncoded 
MIMO system, s{k), the soft decision vector computed by the iterative detector, a{k), 
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Figure 4.2: Block diagram of the receiver structure. 
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is provided to the EKFS for the coded MIMO system. The EKFS is initialized with the 
state estimate ^(0) = and the error covariance estimate M(0) = o"^I. 

After filtering is completed for the whole block, a backward recursion is performed 
to smooth the estimates. Finally, the smoothed estimates of the phase noise parameters 
are carried out to be fed to the detector. The smoothed estimate of the phase noise 
vector, (f){k), and the error covariance matrix lsA{k) are given by 



^(A:) = 4, {k)+M {k)(M {k))-^(^cf){k + l)-4) (k) 
M(/c) = M^{k)+M'^{k){M'{k))-^(M{k + l)-M^{k) 

T 



x(M'{k){M (k)) 



-1 



(4.34) 



(4.35) 



After the backward recursion is completed the block of phase noise estimates (f){k),k 
1,2, ... ,Lf, is fed to the iterative detector for the next EM algorithm iteration. 



4.2.5 Iterative Detector 

It is shown in Sec. 4.2.3 that soft decisions, i.e., the marginal posterior probabilities 
of the coded symbol vectors A are required for the EKFS. The computation of the 
true posterior probabilities has a complexity that increases exponentially with the frame 
length Lf. Therefore, a near optimal iterative detector, operating according to the 
turbo principle [19], [20], [21] is used to obtain the marginal a posteriori bit probabilities 
given the phase noise estimates and the channel gain matrix H. Then, a soft modulator 
maps the a posteriori bit probabilities to symbol probabilities and constructs the soft 
decisions. The block diagram of the proposed EM-based receiver structure, including 
both the EKFS and the iterative detector, is shown in Fig. 4.2. 

The iterative detector first computes M^* conditional likelihoods of the symbol vec- 
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tors given the phase noise estimates as 

p(Y|s(A;),0^'"'^)=p(y(A;)|s(A;),0^*"'^) 

= C'exp (- 2^ \y{k) -MkHk)\^) • (4.36) 

Note that the conditional hkehhoods are computed by the equahzer from the received sig- 
nal before the execution of the detector iterations. Iterative detection is then performed 
with 3 nested iterations, as seen in Fig. 4.2. 

The iterative part of the detector operates according to the turbo principle. The 
conditional a posteriori probability of the transmitted symbol at the transmit antenna 
m, at time instance k, Sm{k), is factored as the product of an a priori probability (with 
subscript a), and an extrinsic probability (with subscript e) such as 

p(s^(fc)|Y,©^'"'^) = C^'^PaiSm{k))peiSmik)) (4.37) 

where C^^^ is a normalization constant. Note that since an interleaver at the transmitter 
side is used, the transmitted symbols on each antenna and the transmitted bits within 
each constellation sjmibol are independent. The extrinsic symbol probabilities in (4.37) 

are computed by the equalizer in Fig. 4.2. The extrinsic symbol probability given the 
estimated phase noise parameters and the received signal Pe{sm{k) = an) for o„ G O, n = 
1,2, . . . ,M, is given by 

Pe{Sm{k) = an) = p(Y\Sm{k) = an,@^^ 

= {p(Y|s(fc),0^^-^^) 

s{k):sm{k)=an 

X n PaMk))]. (4.38) 

The a priori symbol probabilities Pa{sm{k,d)) are computed by the soft modem and fed 
to the equalizer after decoding is performed. Therefore, the first iteration is between 
the equalizer and the soft modem and there are Leqsm iterations. The soft modem 
consists of the demapper, the interleaver, the iterative MAP decoder, the deinterleaver 
and the mapper as it is shown in Fig. 4.2. The demapper takes the extrinsic symbol 
probabilities from the equalizer and computes the extrinsic bit probabilities. The bit 
posterior probabilities of the dth bit of the bit sequence mapped to the symbol Sjn{k), 
denoted as Sm{k,d), is factored similar to (4.37) as 

p(sm{k,d)\X@^'~') =C^''^PaiSmik,d))Pe{Smik,d)). (4.39) 

where C^^^ is a normalization constant. Then, the extrinsic bit probability for /? G {0,1} 



36 



4.2. CODED MIMO 



CHAPTER 4. PHASE NOISE ESTIMATION 

FOR MIMO SYSTEMS 



is computed by the demapper as 

Pe{Smik,d) = P) = p(Y\Smik,d) = 

= ^ \^Pe{Smik) = an) 

anEii:a„{d)=/3 

l[pa{Sm{k,d'))}- (4.40) 

The demapper also needs the a priori bit probabilities computed by the MAP decoder. 
The second iteration of the 3 nested iterations of the detector is performed between the 
demapper and the decoder i^dm-dc times. After the demapper computes all the extrinsic 
bit probabilities, they are deinterleaved and provided to the MAP decoder by the deinter- 
leaver. The decoder takes the deinterleaved extrinsic bit probabilities and computes both 
the deinterleaved posterior and the deinterlaved a priori bit probabilities exploiting code 

properties with L^iec iterations. The posterior bit probabilities p^Sm(fc5C?)|Y,0^ are 

sent out of the detector, interleaved and used to construct soft decisions for the EKFS, 
described in Section 4.2.4. The posterior bit probabilities are also used for hard decision 
after the algorithm terminates. The a priori bit probabilities Paisn{k,d)) are sent to 
the interleaver which constructs the a priori bit probabilities that are used as a priori 
information by the demapper. Finally, the mapper converts a priori bit probabilities 
to a priori symbol probabilities which are used as a priori information by the equalizer 
according to 

ik,d)) = n^''^(^"(^'^))- (^-^i) 

d 

Aforementioned, the iterative detector provides the EKFS with the marginal poste- 
rior probabilities of the coded symbol vectors, p^{kjY,@^ The E-step is finished 
by the computation of these probabilities as 

p(s(fc)|Y,0^'"'^) =C(3)p„(s(fc))pe(s(A:)) (4.42) 

= C(%(Y\s{k),@^"'')llpaism{k,d)) (4.43) 

m,d 

where C^^) and C(^) are normalization constants. Then, these posterior probabilities are 
used to construct the soft decision, a.{k). 

The a priori symbol probabilities Pa{s„i{k)) and bit probabilities Pa{sm{k,d)) are 
initialized with a uniform distribution at the first EM algorithm iteration. A sufficient 
number of iterations inside of the detector is required for convergence if the detector 
is reinitialized with uniform probabilities at each EM iteration. Instead, the detector 
can be initialized with the a priori probabilities obtained at the previous EM iteration. 
In addition, only 1 iteration is allowed inside of the iterative detector for each nested 
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iteration, i.e., L^q_dm. = Ldm-dc = L^ec = 1 as suggested in [21]. This alternative 
approach requires more EM iterations but less detector iterations to converge. In this 
way, the computational complexity of both the detector and the receiver can be reduced 
significantly. 



4.2.6 Simulation Results 

At the transmitter, data bits are first encoded by a rate R = 7/8 regular LDPC encoder 
from the NASA Goddard technical standard [26]. It is a regular code with variable 
node degree 4 and check node degree 32. The number of data bits in each frame, Lf, 
is equal to 7154. Then, encoded bits are modulated onto 16-QAM symbols. Therefore, 
there are Lj = Lb / NtRlog2{M) = 1022 symbol vectors in each frame. Performance 
will be measured as a function of E^/Nq, where Eh denotes the transmitted energy per 
information bit and A'^o is the power spectral density of the AWGN, i.e, cr^ = Aq. 

The convergence of the EM based estimator is severely dependent on the initialization 
of the estimation parameters. First, the EM based algorithm is initialized by a data aided 
(DA) estimator to provide the initial phase noise estimates. Pilots are inserted into the 
data stream every pr time instance. At the first EM algorithm iteration, the EKES makes 
use of the pilots and estimates phase noise values at each pr time instance. Afterwards 
a linear interpolation is performed between two consecutive phase noise estimates. As 
a result, initial phase noise estimates are obtained and sent to the iterative detector to 
initialize the EM-based algorithm. DA{pr) denotes the DA estimator with pilot rate pr- 

In Fig. 4.3, the effect of the phase noise on the BER performance corresponding 
to the EM-based algorithm with DA(14) estimator for different phase noise innovation 
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Figure 4.4: FER performance of the EM-based algorithm at several iterations where cr^ 
5 • 10~^, and DA initial estimation with pr — 14. 




Eh/ No (dB) 

Figure 4.5: MSE performance of the EM-based algorithm, and DA initial estimation with 
Pr — 14 for several phase noise processes and EM algorithm iterations. 



variance levels, o"^, after the 3rd EM algorithm iteration is shown. As compared to 



perfect synchronization, no phase noise scenario, the proposed EM-based algorithm gives 
rise to a BER degradation of about IdB in the presence of the slowly time varying 
phase noise, i.e., o"^ = 2.5 • 10^^. The BER degradation amounts to about 2dB when 
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Figure 4.6: FER performance of the EM-based algorithm, and DA initial estimation with 
— 14 for several number of decoder iterations, cr^ = 5 • 10^''. 



0"^ = 1.5 • 10~^. It is possible to track a stronger phase noise process with innovation 
variance cr^ = 2.5- 10~^ in expense of 4dB of Ei,/Nq comparing to perfectly synchronized 
system. Note that the performance of the system tends to stay constant as Eh/No 
increases, yielding an error floor. The main reason is that the prediction error of the 
EKFS is determined by the phase noise innovation variance. As cr^ increases, the error 
floor is observed at higher error rates. 

Code-aided synchronization techniques offer to improve the overall accuracy and 
performance of the system. First, we investigate the performance of the EM-based 
algorithm at each EM algorithm iteration. The EM-based algorithm does not converge 
to the global solution at some of the erroneous frames resulting in an arbitrary large 
number of erroneous bits. For this reason the BER performance of the system may not 
increase at each EM algorithm iteration. Therefore, the FER performance of the system 
is investigated. Fig. 4.4 shows the FER performance at several EM algorithm iterations 
for fj^ = 5 • 10~^. We observe that the FER performance of the system improves at 
each EM algorithm iteration. In order to operate the system at 2 • 10~^ FER at the 
10th iteration, additional E^/Nq of about 2dB is required. Secondly, we investigate the 
estimation accuracy of the EM-based algorithm. The MSE of the phase noise estimates 
at the first receive antenna is averaged over the successfully decoded frames. Fig. 4.5 
shows the MSE results of different levels of phase noise innovation variance at both the 
1st and the 5th EM algorithm iteration. It is seen that the proposed EM-based algorithm 
not only increases the overall performance of the system but also yields better estimates 
at each EM algorithm iteration. 

We also investigate the performance of the proposed EM-based algorithm for the 
system that is affected by a severe phase noise process such that a\ = h ■ 10~^. Fig. 
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4.6 shows the effect of the number of decoder iterations on the FER performance of the 
system for a fixed Eh/No = 20dB. We observe that the performance of the system does 
not improve significantly after a few EM algorithm iterations. In contrast, the FER 
performance of the system can be slightly improved with more iterations inside of the 
decoder. In order to achieve lower error rates in the presence of strong phase noise a 
stronger channel encoder can be used, i.e, the rate of the LDPC code, R, needs to be 
decreased. Note that the spectral efficiency of the system also reduces with decreasing 
R yielding low throughput. 

Fig 4.7 shows the FER performance of the EM-based algorithm for = 5 • 10~^ 
where data bits are encoded by a rate R = 1/2 LDPC encoder [38]. We observe that 
the FER performance can be improved significantly by increasing the number of EM 
iteration. It is possible to achieve 5 • 10"'^ FER in expense of 4dB of Ei,/Nq comparing 
to no phase noise scenario. However, the error floor still occurs. It is concluded that the 
number of the decoder iterations of the EM-based algorithm, -L^eci should be tuned to a 
sufficiently large number to be able to track time varying phase noise. 
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5.1 Conclusion 

In this thesis, phase noise estimation in uncoded/coded SISO and MIMO system is 
analyzed. 

In Chapter 3, phase noise tracking is performed by a hard decision directed EKF 
for the uncoded SISO system. Numerical results shows that the EKF is able to track 
slowly time varying phase noise processes. Unsurprisingly, the BER degradation reaches 
large values when the phase noise innovation variance is high. Additionally, in Chapter 
3, the problem of joint phase noise estimation and detection in a coded SISO system 
with LDPC codes is discussed. The EM-based algorithm proposed in [8] is modified and 
analytically derived. Two estimators, a soft decision directed KS-MLA and a soft deci- 
sion directed EKS proposed in [8] are applied to carry out the maximization step of the 
EM-based algorithm. In [8], the KS-MLA is claimed to have superior performance than 
the EKS. However, numerical results in Chapter 3 indicates that when phase noise over 
the frame reaches very large values, i.e., in the case of large block length and/or phase 
noise innovation variance, the performance of the KS-MLA degrades significantly and 
the EKS performs better than the KS-MLA. The KS-MLA removes the data dependency 
by multiplying the observed signal with the soft decision symbol. As a result, the per- 
formance of the KS-MLA degrades faster than the EKS when the soft decisions are less 
reliable. For instance, for the same phase noise innovation variance, the EKFS performs 
better than the KS-MLA when the constellation density increases. A trick to increase the 
algorithm speed is also discussed and shown to decrease the overall complexity required 
for convergence. 

In Chapter 4, a low complexity hard decision directed EKF is derived and applied to 
an uncoded MIMO system. Simulation results show that the EKF performs close to the 
synchronized system in the case of slowly time varying phase noise process. The problem 
of joint estimation of the time varying phase noise and data detection for a LOS-MIMO 
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system using bit interleaved coded modulation and LDPC codes is also discussed. An 
iterative EM-based receiver to perform code-aided synchronization is proposed. A new 

low complexity soft-decision directed EKFS is derived and embedded into the EM-based 
algorithm. The performance of the system is investigated in terms of the BER and the 
FER. Estimation accuracy of the phase noise parameters is presented with average MSE 
curves. Computational complexity of the system is also discussed. Computer simulations 
show that the number of bit errors does not decrease at each EM algorithm iteration if the 
algorithm fails to converge. Instead, the FER performance is shown to decrease at each 
EM iteration. Simulation results demonstrate that the proposed EM-based algorithm 
estimates and compensates the time varying phase noise with a small degradation of 
the performance for a wide range of phase noise innovation variances. However, an 
error floor occurs at high signal-to-noise ratio levels. To reduce the error floor and to 
track the phase noise process with large innovation variance decoding performance can 
be increased by setting the number of decoder iterations to larger values. However, the 
achieved performance gain is not significant comparing to the introduced complexity. On 
the other hand, coding rate can be reduced further to protect data bits, yielding better 
soft decisions. The FER performance can be significantly improved by utilizing low rate 
LDPC codes at the expense of a decrease in throughput. As a result, the EKFS can 
be applied to a coded LOS-MIMO system for the wide range of phase noise innovation 
variances. The system parameters should be set to achieve the target performance. 

5.2 Future Work 

In Chapter 4, the channel gains are assumed to be known at the receiver side. The 
efi"ects of the estimation errors of the channel gains on the performance of the EM-based 
algorithm is not investigated. The channel gains can be obtained by a conventional data- 
aided estimator. Additionally, the channel estimation of the block fading MIMO systems 
can be embedded into the EM-based algorithms and initial estimates can be improved 
at every EM algorithm iteration. Therefore, this work can be extended to joint phase 
noise and channel estimation and data detection. In [27], a data-aided LS estimator a 
decision-directed WLS estimator and a new decision-directed EKF is proposed. These 
estimators can be used in the EM-based algorithm to carry out the maximization step. 
Finally, statistics of the phase noise estimates can be used by taking into account in the 
decoding process. A receiver employing factor graphs can be implemented and to track 
strong phase noise processes. 
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